Assessor Resource

DEFTE006A
Analyse test data

Assessment tool

Version 1.0
Issue Date: May 2024


This unit was developed for Defence test and evaluation workers but is applicable to individuals who work in this field.

Typically these individuals must work independently or as part of a team under direct and indirect supervision, use discretion and judgement, and take responsibility for the quality of their output. All activities are carried out in accordance with relevant organisational policy and procedures.

This unit covers the competency required to analyse data collected during a test and evaluation process. It includes establishing trends and relationships in the data, and establishing the acceptability of the data.

You may want to include more information here about the target group and the purpose of the assessments (eg formative, summative, recognition)

Prerequisites

Not applicable.

Employability Skills

This unit contains employability skills.

Pre-requisite Unit/s

Nil



Evidence Required

List the assessment methods to be used and the context and resources required for assessment. Copy and paste the relevant sections from the evidence guide below and then re-write these in plain English.

Critical aspects for assessment and evidence required to demonstrate competency in this unit

Nil

Consistency in performance

Competency should be demonstrated over time and should be observed in a range of actual or simulated work contexts.

Context of and specific resources for assessment

Context of assessment

Competency should be assessed in the workplace or in a simulated workplace environment.

Specific resources for assessment

Access is required to:

computer and relevant software or laboratory information system

data sets and records

relevant workplace procedures.

Guidance information for assessment

In all cases, practical assessment should be supported by questions to assess required knowledge and those aspects of competency which are difficult to assess directly. Questioning techniques should suit the language and literacy levels of the candidate.

Assessment methods should reflect workplace demands such as literacy and the needs of particular groups.

Assessment methods suitable for valid and reliable assessment of this unit may include, but are not limited to, a combination of:

authenticated evidence from the workplace and/or training programs

case studies

demonstration

feedback from supervisors and peers regarding the candidate's ability

observation

portfolios

projects

questioning

reviews or reports prepared by the candidate

scenarios

simulation or role plays.

Submission Requirements

List each assessment task's title, type (eg project, observation/demonstration, essay, assingnment, checklist) and due date here

Assessment task 1: [title]      Due date:

(add new lines for each of the assessment tasks)

Assessment Tasks

Copy and paste from the following data to produce each assessment task. Write these in plain English and spell out how, when and where the task is to be carried out, under what conditions, and what resources are needed. Include guidelines about how well the candidate has to perform a task for it to be judged satisfactory.

This describes the essential skills and knowledge and their level, required for this unit.

Required Skills

complete mathematical calculations such as fractions, decimals, ratios, proportions and percent

evaluate mathematical formulae

interpret scientific properties

prepare and interpret data

prepare and interpret graphs

Required Knowledge

characteristics of a valid measurement

procedures for data traceability

procedures for maintaining and filing records, security of data

procedures for verifying data and rectifying mistakes

relevant scientific terminology

sources of uncertainty in measurements

The Range Statement relates to the Unit of Competency as a whole. It allows for different work environments and situations that may affect performance. Bold italicised wording in the Performance Criteria is detailed below.

Data may include

Audio

Electronic (digital or analogue) recordings/logs

Imagery including satellite

Linear, semi-log and log-log graphs

Observations

Physical components

Physical evidence

Qualitative statements

Statistical results

Calculations of scientific quantities may include

Electrical properties: conductivity, resistivity, dielectric constants

Mathematical calculations such as: algebraic, logarithmic, exponential, power functions, means, medians, modes, ranges, standard deviations, regression line equations and correlation coefficients

Mechanical properties: stress, strain, elastic moduli, yield strength, hardness

Optical properties: absorbance/transmittance, path length, extinction coefficient, concentration (Beer's Law), detection limits

Percentage and absolute uncertainties in measurements and test results

Quantities associated with quality control monitoring, assessment and reporting

Thermal properties: heat capacity, thermal expansion, thermal conductivity, thermal resistance

Analysis may include

Graphical analysis including:

determination of linear, logarithmic, exponential and power relationships

regression lines and interpretation of correlation coefficients

Statistical analysis including:

analysis of variance (ANOVA)

data acceptability tests, such as Q, T and Youden

histograms, frequency plots, stem and leaf plots, boxplots, scatter plots

means, medians, modes, ranges and standard deviations

Pareto diagrams, Stewhart control charts, CuSum control charts

probability, normal probability plots

regression methods for calibration, linearity checks, comparing analytical methods

Organisations may include

Defence

Defence contractors and sub-contractors

Defence Materiel Organisation

Defence Science and Technology Organisation

International test agencies

Universities

Statistical properties may include

Frequency distributions

Means

Medians

Modes

Ranges

Standard deviations

Copy and paste from the following performance criteria to create an observation checklist for each task. When you have finished writing your assessment tool every one of these must have been addressed, preferably several times in a variety of contexts. To ensure this occurs download the assessment matrix for the unit; enter each assessment task as a column header and place check marks against each performance criteria that task addresses.

Observation Checklist

Tasks to be observed according to workplace/college/TAFE policy and procedures, relevant legislation and Codes of Practice Yes No Comments/feedback
Consistency of raw data with expectations and reasonable ranges is ensured 
Scientific quantities are calculated 
Calculated quantities and estimations are accurately determined. 
Results are presented using the appropriate units, uncertainties and number of significant figures 
Relationships are determined between sets of data 
Data are prepared and analysed to determine if a process is in control 
Possible causes for out-of-control condition are identified 
Organisational procedures are followed to return process to in-control operation 
Raw data is organised into appropriate frequency distributions 
Statistical properties are calculated for ungrouped and grouped data 
Statistical properties are interpreted to determine characteristics of sample or population 
Standard deviations and confidence limits are calculated for means and replicates 
Uncertainty in measurements is determined using statistical analysis 
Data acceptability is determined using statistical tests and organisational procedures 
Results that cannot be reconciled with documentation, testing procedures and/or expected outcomes are identified 
Appropriate actions are determined in consultation with supervisor as required 
Data is stored, retrieved and manipulated following document traceability procedures 
Results are presented in an appropriate format 
Entry of data and results are verified as correct 
Security and confidentiality of data is maintained in accordance with workplace and regulatory requirements 
Reports are prepared in a format and style consistent with their intended use and organisational guidelines 

Forms

Assessment Cover Sheet

DEFTE006A - Analyse test data
Assessment task 1: [title]

Student name:

Student ID:

I declare that the assessment tasks submitted for this unit are my own work.

Student signature:

Result: Competent Not yet competent

Feedback to student

 

 

 

 

 

 

 

 

Assessor name:

Signature:

Date:

Assessment Record Sheet

DEFTE006A - Analyse test data

Student name:

Student ID:

Assessment task 1: [title] Result: Competent Not yet competent

(add lines for each task)

Feedback to student:

 

 

 

 

 

 

 

 

Overall assessment result: Competent Not yet competent

Assessor name:

Signature:

Date:

Student signature:

Date: